Branching Gaussian Processes with Applications to Spatiotemporal Reconstruction of 3D Trees

نویسندگان

  • Kyle Simek
  • Ravishankar Palanivelu
  • Kobus Barnard
چکیده

We propose a robust method for estimating dynamic 3D curvilinear branching structure from monocular images. While 3D reconstruction from images has been widely studied, estimating thin structure has received less attention. This problem becomes more challenging in the presence of camera error, scene motion, and a constraint that curves are attached in a branching structure. We propose a new generalpurpose prior, a branching Gaussian processes (BGP), that models spatial smoothness and temporal dynamics of curves while enforcing attachment between them. We apply this prior to fit 3D trees directly to image data, using an efficient scheme for approximate inference based on expectation propagation. The BGP prior’s Gaussian form allows us to approximately marginalize over 3D trees with a given model structure, enabling principled comparison between tree models with varying complexity. We test our approach on a novel multi-view dataset depicting plants with known 3D structures and topologies undergoing small nonrigid motion. Our method outperforms a state-of-the-art 3D reconstruction method designed for non-moving thin structure. We evaluate under several common measures, and we propose a new measure for reconstructions of branching multi-part 3D scenes under motion.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Generative statistical 3D reconstruction of unfoliaged trees from terrestrial images

This paper presents a generative statistical approach for the automatic three-dimensional (3D) extraction and reconstruction of unfoliaged deciduous trees from terrestrial wide-baseline image sequences. Unfoliaged trees are difficult to reconstruct from images due to partially weak contrast, background clutter, occlusions, and particularly the possibly varying order of branches in images from d...

متن کامل

Novel 3D Microscopic Analysis of Human Placental Villous Trees Reveals Unexpected Significance of Branching Angles

The villous trees of human placentas delineate the fetomaternal border and are complex three-dimensional (3D) structures. Thus far, they have primarily been analyzed as thin, two-dimensional (2D) histological sections. However, 2D sections cannot provide access to key aspects such as branching nodes and branch order. Using samples taken from 50 normal human placentas at birth, in the present st...

متن کامل

3D Reconstruction Using Cubic Bezier Spline Curves and Active Contours (Case Study)

Introduction 3D reconstruction of an object from its 2D cross-sections (slices) has many applications in different fields of sciences such as medical physics and biomedical engineering. In order to perform 3D reconstruction, at first, desired boundaries at each slice are detected and then using a correspondence between points of successive slices surface of desired object is reconstructed. Mate...

متن کامل

Effect of Post-Reconstruction Gaussian Filtering on Image Quality and Myocardial Blood Flow Measurement with N-13 Ammonia PET

Objective(s): In order to evaluate the effect of post-reconstruction Gaussian filtering on image quality and myocardial blood flow (MBF) measurement by dynamic N-13 ammonia positron emission tomography (PET), we compared various reconstruction and filtering methods with image characteristics. Methods: Dynamic PET images of three patients with coronary artery disease (male-female ratio of 2:1; a...

متن کامل

3d Reconstruction of Roads and Trees for City Modelling

Laser altimetry is a valuable data source for the production of 3D city models. For applications of 3D city models that are to provide a realistic impression of the urban environment, modelling of the buildings only is insufficient. This paper presents methods for the reconstruction of the street surfaces by combining airborne laser data with 2D information from a cadastral map. Locations of tr...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016